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1. 


INTRODUCTION 


An  ergodlc  matrix  is  a  nonnegative  matrix  with  a  special  property  to 

be  defined  in  the  next  section.  Such  matrices  occur  in  finite  Markov  chain 

theory,  mathematical  economics,  sociology,  and  similar  applications.  In 

1950  Wielandt  [7]  conjectured  that  an  ergodic  matrix  was  regular  (to  be 

2 

defined)  if  and  only  if  its  n  -2nf2  power  had  all  entries  positive.  The 
first  published  proof  of  this  fact  was  by  Rosenblatt  [5]  who  also  established 
many  other  facts  concerning  such  matrices.  Subsequently,  two  other  proofs 
by  Holladay  and  Varga  [1]  and  Perkins  [4]  have  appeared. 

In  this  paper  a  new  elementary  completely  independent  proof  is  given 
that  gives  rise  t  some  simple  algorithms  for  determining  whether  an  ergodic 
matrix  is  regular  or  cyclic.  The  work  in  carrying  out  these  algorithms  is 
considerably  less  (in  the  numerical  analysis  sense)  than  that  of  previous 
ones. 

The  author  is  indebted  to  Professor  John  G.  Kemeny  for  advice  during 
the  preparation  of  the  paper  which  led  to  substantial  improvement  of  the 
algorithms. 


2.  PRELIMINARY  RESULTS 

Let  A  be  a  nonnegative  nxm  matrix.  We  shall  denote  the  set  of  row 

(t) 


and  column  indices  by  S  °  {l,...,n}  and  call  them  states.  Let  a 


ij 


be  the  i,jth  element  of  A  .  We  say  that  state  i  can  contact  state  j 
in  t  steps  if  >  0,  The  immediate  successors  of  i  are  those  states 

it  can  contact  in  one  step,  and  the  successors  of  i  are  those  states  it 
can  contact  in  one  or  more  steps.  The  immediate  predecessors  and  predecessors 


of  i  are  defined  analogously.  The  matrix  A  is  said  to  be  ergodic  if  every 
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state  as  Its  successor,  that  is,  every  state  can  contact  every  other  state. 
There  are  easy  algorithms  for  checking  for  ergodicity,  see  e.  g.  ,  [3], 
Chapter  VII,  Section  2. 

Let  S.  be  the  set  of  states  that  i  can  contact  in  exactly  t 
I  i  c 

steps  for  t  >  1.  Define  q  -  {i}.  Let  ^  U  ...  U  be 

the  set  of  states  1  can  contact  in  1  through  t  steps. 

LEMMA  1.  (a)  S,  is  uniquely  determined  by  S.  for  q  >  1. 

X  |  CtO  1  )  L 

(b)  If  S.  +  S  for  positive  integers  t  and  m  then 


S.  u  -  S.  .  for  all  h  >  t. 
i  ,h+m  i  ,h  - 

(c)  Every  state  can  contact  every  other  state  in  at  most  n-1  steps. 
PROOF.  (a)  Note  that  S,  .  consists  of  the  column  indices  of  the 

X  |  1 

positive  entries  of  the  ith  row  of  A,  and  hence  is  uniquely  determined. 
Assume  S.  ,  is  uniquely  determined  by  S.  ..  Then  S.  consists  of  the 

Xfl.saX  1)1  1  )  L 

column  indices  of  the  positive  entries  of  the  rows  whose  indices  are  in 

S .  .  ,  which  is  a  unique  set.  Hence  S .  is  uniquely  determined  by 

1  y  t“l  i  »  t 

Sn  ■  fil.  So  i 8  S.  ,  and  the  statement  follows. 

U  1 ,  t+q 

(b)  If  S.  . ,  -  S.  .  for  positive  integers  t  and  m,  then  it 

1 }  t » in  1 )  t 

follows  from  (a)  that  hence  (b)  follows  by  finite 

induction. 


(c)  Consider  the  sequence 

(1) 


{‘J-Ti  oSXi^S-  ST1>t 


Note  that  T^  k  -  T^  k+1  only  if  k+1  e  T1  k>  and  (a)  implies  that 

the  latter  can  hold  only  if  S  ,  c  T.  ,  for  all  h  ;>  k.  Hence  the  sequence 

x )  n  1 1  k 

(1)  is  strictly  increasing  for  a  certain  number  of  terms  and  then  constant. 
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Because  A  la  assumed  to  be  ergodic,  T.  ■  8  for  t  sufficiently  large. 

i 

However,  the  sequence  (1)  can  be  strictly  Increasing  for  at  most  n-1  steps, 

since  at  least  one  new  state  must  be  added  each  time  i  nd  there  are  n  states 

in  all.  Hence  T,  -  -  S,  which  is  (c). 

i  ,n-l 

LEMMA  2.  (a)  For  each  i  there  is  a  smallest  positive  integer  m 


for  which  8.  ...  -  8.  .  for  some  t.  Moreover  m  <  n. 

i ,  t+m  i ,  t 

(b)  For  t  sufficiently  large  S  -  8 .  .  ^  .  U  S.  .  • 

1 1 1  1.  j  t*  in  **  J. 

(c)  The  smallest  m  given  by  (a)  is  the  same  for  every  i. 

(d)  The  sets  8 .  S.  ,,...,  S.  ..  ,  partition  S. 

l,t  lit-rl  i  f  t+m-l 

PROOF,  (a)  Since  A  is  ergodic  there  is  a  smallest  positive 


integer  m  such  that  i  is  a  member  of 
follow,  th.t  Sl  qniC  St  (q+1)M  for  q  - 


s.  . 

i  ,m 


By  Lemma  1(c),  m  ^  n. 


It 


0,  1,  ...  .  Consider  the  sequence 


(2) 


S.  n  C  S  .  C  S  .  0  C  .  •  •  c  S.  /  ,  ,  v  . 
i,0-  i,m  -  i,2m—  -  i,(q+l)m 


By  Lemma  1(b)  this  sequence  is  strictly  increasing  for  a  few  terms  and 

then  constant.  Hence  there  is  a  smallest  q  such  that  S.  ■  S. 

1  i  ,  qm  i , qmf m 

Setting  t  •  qm  we  conclude  that  there  is  at  least  one  m  satisfying  the  condition. 
The  set  of  possible  m  is  finite  and  has  a  least  member,  which  is  the  one  whose 
existence  is  asserted  in  (a). 

(b)  Let  m  be  as  in  (a)  and  let  t  be  large  enough  that  S.  *  S.  • 

1 ,  t+m  I ,  t 

By  Lemma  1(b)  the  sequence  of  ^  for  h  >  t+m  simply  repeats  the  sequence 

S .  _ ,  S.  ^  S.  Since  A  is  ergodic  S  is  contained  in  the 

i,t  i,t+l  i,t+m-l 

union  of  these  sets.  And  since  S  contains  each  one,  it  contains  their  union. 


(c)  (This  proof  is  adapted  from  Kemeny  and  Snell  [2],ppgs.  5-7.)  Let 


be  the  set  of  times  at  which  a  message  starting  from  i  can  reach  j. 
In  particular,  is  the  set  of  times  that  a  message  can  return  to  i. 
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The  set  N^  la  closed  under  addition,  since  if  a  and  b  are  two  such 
times  then  a  +  b  is  also  such  a  time.  By  a  well  known  theorem  a  set  of 
positive  integers  that  is  closed  under  addition  contains  all  but  a  finite 
number  of  positive  multiples  of  the  greatest  common  divisor  of  the  numbers 
in  the  set.  Let  d^  be  the  greatest  common  divisor  of  the  numbers  in  N^. 

In  the  next  two  paragraphs  we  let  a  and  b  be  members  of  N^  and 
c  a  member  of  N^. 

Since  a  is  a  time  that  i  can  send  to  j  and  c  a  time  that  j  can 
send  to  i,  we  see  that  afc  belongs  to  N^;  hence  afc  =  0  mod  d^.  It  is 
also  possible  to  send  a  message  from  i  to  J  in  time  a,  from  j  back  to  itself 
in  time  kd.,  and  then  from  j  to  1  in  time  c.  Hence  af-kd.+c  =  0  mod  d.. 

J  j  1 

Hence  kd^  -  hd^  for  some  h.  Since  k  can  be  any  large  prime  number,  d^  is 
divisible  by  d^.  By  a  symmetric  argument  d^  is  divisible  by  d^1  Hence 
d^  ■  dj  -  d,  where  d  is  the  common  divisor  for  all  i. 

Finally  note  that  afc  and  bfc  both  belong  to  N^,  and  hence  are 
congruent  mod  d,  hence  a  =  b  mod  d. 

We  know  that  m^  >  d.  But  for  k  sufficiently  large  N^  contains  kd. 
Hence  m.  ■  d  »  m.  for  all  i  and  j. 

1  J 

(d)  As  we  saw,  a  =  b  mod  d.  If  0  4  for  k  4  k* 

and  0  <  k,k'  <  m,  then  there  is  some  j  such  that  i  can  send  to  j  at 
times  t+k  and  t+k'  where  k'-k  <  d,  a  contradiction.  The  fact  that  the 
union  of  S,  S.  ,18  S  is  Lemma  2(b). 

x  j  1 1  l  T  m  *  i 

3.  MAIN  RESULTS 

DEFINITION.  If  m  >  1  then  matrix  A  is  cyclic  with  period  m. 
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If  m  «  1 ,  then  A  1b  regular. 

THEOREM  1.  (a)  Every  ergodlc  matrix  Is  either  cyclic  or  regular. 

(b)  .  A  is  regular  if  and  only  if  there  is  a  positive  integer  N  such 
that  AN  >  0. 

Of  i  \ 

(c)  If  a^  >  0  for  some  i,  then  A  is  regular  and  A  '  '  >  0. 

PROOF,  (a)  Obvious,  since  m  >  1. 

(b)  Since  for  every  i,  t  "  ®i  t+1  "  ®  ^or  8Uffic*ently  large, 

soma  power  of  A  is  positive.  Conversely,  if  the  Nth  power  of  A  is  positive, 
then  8.  „  -  8.  ,  so  that  m  -1. 

1  fN  1  1 

(c)  8.  ■  T,  for  every  t.  Hence  m  -  1.  Since  SJ  .  ■  T,  ,  -  S 

i,t  i,t  1  i,n-l  i,n-l 

by  Lemna  1(c),  we  see  that  ajn^^  >  0  and  a£n^^  >  0  for  all  k.  The 

definition  of  matrix  multiplication  now  implies  that  A^n  ^  >  0. 

There  exist  matrices  (see  matrix  C  in  Section  4)  for  which  the  bound 

in  Theorem  1(c)  is  the  best  possible.  However,  for  specific  matrices  better 

bounds  are  frequently  possible.  E.g.  ,  let  k  be  the  longest  time  it  takes 

to  send  a  message  from  any  state  j  to  1,  and  let  k'  be  the  longest  time 

it  takes  to  send  from  i  to  any  other  state.  Each  of  these  is  less  than  or 

* 

equal  to  n-1.  It  is  easy  to  see  that  A  >0. 

THEOREM  2.  If  A  is  cyclic,  then  by  reordering  the  states  so  that  for 
some  large  t  members  of  S.  are  listed  first,  S,  -  second,  etc.,  taen 

1  y  C  1  |  LT  X 

A  can  be  put  in  the  following  canonical  form: 
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where  A,  is  the  submatrix  with  row  Indices  in  SJ  ^  ,  ,  and  column 
k  i,t+k-l 

« 

indices  in  8.  for  k-1,  ....  m. 
i,t+k 

PROOF.  By  Lemma  2(d),  the  sets  S.  ,  8.  . . S.  ...  . 

l  f  c  X.  i  Ct  JL  1 1 1  t  n\*  i 

partition  8.  By  the  definition  of  S.  .  ,  the  set  8.  .  .  consists  of  the 

1  1  }  in*  1 

successors  of  8^  ^  and  is  uniquely  determined,  hence  the  entries  outbide 
the  A^'s  are  all  zeros.  Since  A  is  ergodlc  every  row  and  column  of  A, 
and  hence  of  A^  must  have  a  nonzero  entry,  therefore  no  further  decomposition 
of  A  is  possible. 


THEOREM  3.  If  A  is  an  nxn  nonnegative  ergodic  matrix  then  either 

2 

An  >0  and  A  is  regular  or  else  A  is  cyclic. 

PROOF.  Suppose  A  is  regular.  Then  S.  -  S  for  every  i  and  for 

1  ,  t 

t  sufficiently  large.  For  each  state  i  there  exists  a  minimum  t  such 

that  ■  S.  Let  1q  be  a  state  whose  minimal  t  is  maximal.  We  must 

2 

show  that  t  <  n  -2n4-2.  Denote  S.  by  S  from  now  on. 

10  ’ 1  1 

Let  k  be  the  smallest  index  such  that  i^  e  S^.  We  know  that 

l<k<n.  If  k-1,  then  by  Theorem  1(c)  A^^°  ^  >  0.  Since 

2  2 

(n  -2nf2)-2(n-l)  -  (n-2)  >  0,  the  theorem  is  true  in  this  case. 

Suppose  now  that  1  <  k  <  n.  Choose  q  to  be  the  largest  positive 
integer  so  that  S  ^  V  Consider  the  sequence 

ri0^  "  V  Sl,’“  ’  Sk**"  ,Sqk,Sqk+r  Sqk+2 . S(q+l)k’  *” 
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j  be  any  element  different  from  i  in  S.;  obviously  such  an 
u  o  l 

element  exists.  Then  «  S  for  all  q  >  1.  Consider  the  sequence, 

S0=SkcS2kC-"  CSqk 

S1  c  Sk+1  C  S2k+1  c  ■  •  c  sqk+l 

The  containing  relationships  in  the  second  sequence  are  a  consequence  of 
those  in  the  first  sequence.  Both  these  sequences  are  strictly  Increasing 
by  Lemma  1(b).  Hence  we  can  choose  the  following  sequence  of  elements: 


*v  e  8vk  S(v-l)k 


*  Svk+1  S(v-l)k+l 

for  v»l,...  ,q.  Because  1^  V  this  can  be  done  at  most  n-2  times,  so 

that  q  ^  n-2.  If  q  <  i-2  then  qfl  <  i-2  and  9(q+^)lc  “  s*  But 

2 

(q+l)k  (n-2)n  <  n  -2nf 2 ,  and  the  theorem  is  true. 

Hence  suppose  that  q-i-2.  Then 

Sqk  "  ^0’  1r,,',in-2^  "  S  fJ0l 


Sqk+1  "  ^0’  J1 . jn-2^  "  S  W 


How  i„  will  be  in  S  .  .  0  since  one  of  its  predecessors  is  in  S  , 

0  qk+2  r  qk+1 

Also  contain  S  ^  ■  S  -  [1q»Jq3  since  all  these  elements 

have  appeared  in  two  adjacent  sets.  Hence  9qjc+2  2  H  ^qk+2  “  ^qk  * 

■  S  -  {j0],  then  by  Lemma  1(b)  A  is  cyclic  with  period  2.  Hence  S  J 

2 

qk+2  £  (n-2)n  +  2  ■  n  -2n+2 . 

n2-2t>f2 

Since  i^  was  a  state  with  largest  minimal  t,  A  >0. 


Now 
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4.  THE  ALGORITHM 

Theorem  3  can,  of  course,  be  used  to  check  on  regularity  of  A  by 

computing  powers  of  A.  Since  we  can  square  A  each  time,  we  need  only 

k  2 

square  k  times  with  k  being  the  smallest  integer  such  that  2  >  n'  -  2n  2. 

3 

However,  squaring  a  matrix  requires  n  multiplications  so  that  this 
represents  considerable  work. 

A  much  more  efficient  algorithm  (in  the  sense  of  requiring  fewer 
numerical  operations)  can  be  based  on  Lemma  2(c)  and  (d),  and  the  obvious 
fact  that  if  two  successive  Sj's  have  a  common  element  then  the  matrix 
is  regular,  since  the  partition  of  Lemma  2(d)  can  then  have  but  one  set. 

No  numerical  operations  are  involved --merely  lookups  to  see  for  each  state 
what  its  successors  are.  The  algorithm  may  be  described  as  follows: 

0.  Let  i  be  any  row  index  (a  good  start  is  to  let  it  be  a 
row  with  maximum  number  of  positive  entries).  Let 
Sq  ■  U  ■  {i};  let  J  ■  t  ■  0;  let  m  ■  oo . 

1.  Let  U  -  Sj 

2.  Let  J  -  J+l,  t  -  t+1. 

3.  Let  Sj  -  {the  immediate  successors  of  elements  of  U)  . 

4.  If  Sj  0  U  4  t  go  to  11. 

5.  If  i  is  not  in  Sj  go  to  1. 

6.  If  t  -  m  go  to  1. 

7.  Let  t  -  m. 

8.  If  m  -  1  go  to  11. 

9.  If  j  ■  n^  -  2n  +  2  go  to  12 , 

1 J .  Let  t  -  0;  go  to  1. 

11.  Stop.  The  matrix  is  regular. 
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12.  8top.  The  matrix  is  cyclic  with  period  m.  The  partition  of 

the  states  is  given  by  S . ,  S  S. ,  .. 

J  .1+1  j+m-i 

There  is  an  additional  instruction  that  can  be  added  to  the  algorithm 

to  speed  it  up,  at  the  expense  of  requiring  more  memory  space.  The 

Instruction  should  be  inserted  between  4  and  5,  and  is 

4e.  If  S  ■  S.  go  to  12. 

J  J 

Note  that  to  Implement  this  instruction  all  the  sets  between  S,  and  S. 

J-"»  J 

must  either  be  saved,  or  recomputed  when  necessary.  A  more  economical  change 
that  requires  at  most  m-1  additional  iterations  of  the  program  is  to  number 
the  additional  instruction  5a,  and  insert  it  between  5  and  6. 

To  illustrate  the  use  of  these  algorithms  consider  the  matrices, 


/ 


A  ■ 


0  1  0  0  0  0 
0  0  1  0  0  0 
0  0  0  1  0  0 
0  0  0  0  1  0 
0  0  0  0  0  1 
1  1  0  0  0  0 


B  - 


0 

0 


1  0  0  0  0  \ 

0  1  0  0  0  \ 


0  0  0  1  0  0 
0  0  0  0  1  0 

0  0  0  0  0  1 

.1  0  0  0  1  0 


1  1  0  0  0  0 
0  0  1  0  0  0 
0  0  0  1  0  0 
0  0  0  0  1  0 
0  0  0  0  0  1 
1  0  0  0  0  0 


The  complete  calculations  that  show  that  A  is  regular  and  B  cyclic 
are  given  below,  using  the  4a  instruction  in  the  algorithm. 


For 

A 

S0 

{6} 

si 

(1.2) 

S2 

(2.3} 

S3 

S4  S5 

For 

B 

{6} 

[1.5} 

(2.6} 

{1,3,5} 

{2,4,6}  {1,3,5} 

Note 

that 

the  a 

lgorithm  is 

such 

that  it  can 

be  done  by  hand ,  even  for 

fairly  large  matrices.  Since  for  n=6,  n  -2rH-2  =  26,  we  see  that  these 
computations  are  considerably  simpler  than  raising  the  matrices  to  the  26th 
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power.  It  can  be  shown  that  A  and  B  are  such  that  their  ergodic 

properties  are  not  evident  before  the  26th  power.  Matrix  C  has  the  property 
9  10 

that  C  >0  and  C  >0,  showing  that  the  bound  in  Theorem  1(c)  is  the 
best  possible. 

In  [6]  the  author  has  published  a  computer  program  (in  the  language 
BASIC)  that  implements  the  algorithm  using  the  5a  instruction. 
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